Weight-Space Geometry of Offline Reasoning Training

Offline reinforcement-learning losses (RFT, RIFT, DFT, Offline GRPO, DPO) are widely used to distill reasoning from large teachers into smaller students, and are typically compared on downstream accuracy alone. We ask whether they are mechanistically distinct or converge to a similar weight update. …

View Post on Scour ↗

More from arXiv on Scour.